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Abstract. Let p g (0, oo) be a constant and let {£„} C L P (Q,,T, P) be a sequence of 
random variables. For any integers m, n > 0, denote S m ,n = £fc- ^ ^ s P rove( i that, 

if there exist a nondecreasing function ip : K+ — > K+ (which satisfies a mild regularity 
condition) and an appropriately chosen integer a > 2 such that 

°° S n v 

>SUpE — 7-^-7 < OO, 

Then 

hm — t— ^ = a.s. 

This extends Theorem 1 in Levental, Chobanyan and Salehi 3 and can be applied conve- 
niently to a wide class of self-similar processes with stationary increments including stable 
processes. 



1. Introduction 

The study on strong law of large numbers has a long history and there is a vast body 
of references on this topic. This note is motivated by our interest in studying asymptotic 
properties of stochastic processes with heavy-tailed distributions. Typical examples of such 
processes are linear fractional stable motion and harmonizable fractional stable motion. See 
Samorodnitsky and Taqqu [7] and Embrechts and Maejima [3]. 

Let p € (0, oo) be a constant and let {£„} C ^(O,^ 7 , P) be a sequence of random 
variables. For any integers m,n > 0, denote 

m+n 

Sm.n = / . Cfc) M m n = max t|. 

*■ — ' k<n 

k=m 

For any nondecreasing function ip : M + — ► such that (f(x) f oo as x — * oo, we say that 
{^ n } satisfies the SLLN with respect to ip (or (/j-SLLN) if 

t °0,n n 

lim — — - = U a.s. 

n— >oo ip[n) 

The following is the main result of this paper, which is an extension of Theorem 1 in 
Levental, Chobanyan and Salehi [3] who considered the case of p > 1 and <p(n) = n. 
Our result improves their theorem in two aspects: (i) it gives sharper norming constants 
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(see Remark 1.2 below) and (ii) it can be applied conveniently to a wide class of self-similar 
processes with stationary increments such as self-similar a-stable processes for all a G (0, 2]. 

Theorem 1.1. Let p > be a constant and let 99 : K + — > R + 6e a nondecreasing function 
such that <p(x) | oo as x — > oo and Ci < (p(2x) /<p(x) < C2 for all x G M+ for some constants 
C2 > Ci > 1. Assume a > 2 is an integer that satisfies (7j 5 L lo §2 a J > max |2 5 2 P }. // we /iaue 



(1.1) ]TsupE 



n=0 



k,a n 



V 

< OO, 



y?(a" 

then {£n} satisfies the ip-SLLN. 

Remark 1.2. If </?(n) = n q (q > 0) or i/?(n) = n <? (logn)^ for g > and /3 € M, then tp satisfies 
the conditions of Theorem 11.11 From Theorem II .11 it is easy to see that if {£, n , n > 1} is a 
sequence of i.i.d. random variables with mean and variance 1, then for any e > 

(1.2) lim 5 °'" = a.s. 

rwoo y/relogn(loglogn) 1+e 

Information on higher moments of S kjTl leads to improvement on the power of logn. For 
example, if {£ n ,n > 1} are i.i.d. standard normal random variables, then for any e > 

(1.3) lim °' n — — = a.s. 

n— >oo yjn (log n) e 

Even though f)l ,2f) and fjl .3f) are less precise than the law of the iterated logarithm, the 
advantage of this method is that it is still applicable when the random variables n > 1} 
are dependent or non-Gaussian. 

Proof of Theorem \1.1\ The proof of Theorem 11.11 is a modification of the proof of Theorem 
1 in Levental, Chobanyan and Salehi [3]. 

Let N = N U {0}. We first consider p > 1. For any k G N , n G N 

(1.4) M ktan +i < max{M fcja n, \S k>a n\ + M k+a n :Cl n}. 
Using the elementary inequality \x + y\ p < 2 p_1 (|rr| p + \y\ p ) we get 

Ml an+1 < ^{Ml an ,2?-\\S k , a n\ p + M? +anan )} 

(1-5) < (2 P - 1 -l)l^| P + ^V+ 2P " lM ^,a- 

Eq. (II. 5j) can be written as 

^1 - l^,a-+i T < M p k an - \S Kan f + 2P" 1 [M p k+an an - \S k+a ^ an |f) 

— |'S , fc,o n + 1 | P + 2 P 1 |5'A;,a™| P + 2 P |<Sfc+a n ,a n | P - 

Dividing both sides by (/?(a ri+1 ) p , taking expectations, and then the supremum over all fc's, 
we get 

ip{a n Y 2 p - l ip(a n Y 
Fn+1 ~ <p(a n + 1 )P Fn+ rftf+Ty F n + Gn 

(1-6) = ^^(l + 2 p - 1 )Fn + G n , nGNo, 

2 



where 

(1.7) 

and 



F n = sup E 

fceNo 



Kan-\Sk,a«\ P 



(f(a n Y 



G n = sup 

fcGN 



2P- 1 tp{a n )P 
ip(a n + 1 )P 



E 



Sk+a n ,a n 



<f(a r ' 



2P-V(a") p 



E 



£fc,a n 



Now by the assumptions on ip and a, we have 
(1.8) 



E 



— -tt— (1 + 2P- 1 ) < —-. r := c < 1, 



ip(a 



n £ N, 



o- 



Then -F n +i < cF n + G n and it is easy to show by induction in n that 

n 



1 — c ^— ' 



fc=0 

By summing up (jl.6p from ra = to oo we get 
(1.9) y E (M p a ^-\S a ^\P 

It follows from (jl.ip that ^,^L ^™ < 00 • 

Next we consider the case < p < 1 and establish an inequality similar to (jl.9p . Using 
(jl.4p and the elementary inequality \x + y\ p < \x\ p + \y\ p as in [3] we get 

M£ on+1 < max{M fc V, + M£ +o „ fln } 

(1-10) < K on +M^ a „ a „. 

It follows that 

~~ \Sk,a n + 1 \ P + \Sk,a n \ P + |<S'fc+a n ,a n | P - 

Dividing both sides by ip(a n+1 ) p , taking expectations, and then the supremum over all fc's, 
we derive 



<p(a n Y „ , <p(a n Y 



Fn+l ~ <o(nn+l\V Fn + 



(1.11) 



(p(a n+1 )P ip(a n+1 )P 



<p(a 



n+l\p 



F n + H n , n G Nq, 



where F n is defined as in (jl.7p and 



ff„ = sup 



V9(2 n )f 
V?(a n+1 )P 



E 



S, 



k+a n ,a n 



<p(a n ) 



" + ^ E 

^( a n+l)p 
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5, 



fc,a r ' 



</?(a n ) 



E 



*5'fc,o ri + 1 



V?(a 



Again, it follows from the assumptions on tp and a that 
(1.12) < n i :=c<l, nGN . 

By using induction in n we derive 

n 

F n+l <Y,c n - k H k , n£N . 

fc=0 

Hence, by summing up (jl.lip from n = to oo we get 

n=0 n=0 

Eq. (jl.ip implies that ^2^=0 H n < oo. 

By combining (jl.9p and (|1.13p . we see that almost surely 

(1.14) _ ,0, asn^oo. 

Note that (jl.ip also implies that 

(1.15) — r- 2 — ; ► 0, as n — > oo. 

v ; ip(a n ) 

Therefore, we obtain almost surely 

(1.16) — 7 > 0, as n — > oo. 

v ' ip(a n ) 

Since 

(1.17) , nf y(a n+1 ) ^ gL io g2 aJ > 1 

n p(a n ) 

we have 



Af a »«» (^(a n+1 ) -^(a") M a n ja n 



(1.18) 



y?(a n ) </?(a n ) c/?(a n+1 ) - ip(a n ) 

> (r llog 2 a\ _ Ml", a" 



and hence 

(L19) ^a«+i)-^(a«) °' aS n °°- 

Now by the assumption on <p, 

(1.20) gffi<c}^ 

and by using Theorem 9.1 in Chobanyan, Leventhal and Mandrekar [2], we see that (|1.19p 
implies 

(1.21) lim -^£1 = a.s. 

n-+oo ip(n) 
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This finishes the proof of Theorem 11.11 □ 
The following is an immediate consequence of Theorem 11.11 which is often convenient to 
use. 

Corollary 1.3. Let {£ n ,n > 0} be a sequence of random variables such that for some 
< p < oo and for all integers k,n G No 

nS k , n \P < g(n) 

for a numerical function g . If there is a nondecreasing function (p : R_|_ — * M + as in Theorem 
\1.1\ such that 

^ g(2 n ) „ 
^ ip(2 n \P 



n=0 

then {£ n ,ra > 0} satisfies the (p-SLLN. 



2. Applications 

In this section, we show applications of Theorem 11.11 to quasi-stationary sequences of 
random variables and self-similar processes with stationary increments. 

2.1. Sequence of quasi-stationary random variables. Strong laws of large numbers 
for sequences of quasi-stationary random variables have been considered by several authors; 
see [5j [2] and the references therein. Let / : No — » M + be a non-negative function. We 
say that a real or complex-valued sequence {£ n , n G No} is f- quasi- stationary if E(^) = 0, 
E(£f) < oo for all k G N and 

m^l+m) \ < /("»), l,m GN . 
The following result refines Theorem 1 in [5] and Corollary 2 in [2]. 

Theorem 2.1. Let {£ n , n G No} be an f- quasi- stationary sequence and let ip be a non- 
decreasing function as in Theorem Define 

//^:= E^o^Sf<oo and 



oo 



(2.1) ^ f(m)h(m) < oo, 

m=l 

i/ien f/ie ip-SLLN holds for {^ n , n G No}. 

Proof. By the /-quasi-stationarity of {£ n , n G No}, we derive that for any k,n G No 



E 



if{a n ) 



2 



m=0 y r\ ; m=0 
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It follows that 



supE 



n=0 



fc>0 



Sk,a n 



<p(a n ) 



< " « fl n /(m) 
- 2^ 2^ y,( a n^ 



n=0 m=0 



< ^/(o) + E E 



to— 1 n=Llog a mj 



a n f(m) 
<p(a n ) 2 



< Df(0) + E f(m)h(m) < do. 



m=l 



Hence the conclusion follows from Theorem 11.1 



□ 



2.2. Self-similar processes with stationary increments. Recall that a stochastic pro- 
cess X = {X(t),t G K+} with values in M is called a self-similar process with index H > 
if for all constants c > 0, 



(2.2) 



{X(ci),t E M+} = {c ff I(f),tel + }, 



where = means equality of all finite dimensional distributions. X is said to have stationary 
increments if for every to E 

(2.3) {X(t + t) - X(to),t G M+} = {X(t) - X(0),t G 

If X satisfies both (|2.2p and (|2.3p . then we say that X is -ff-SSSI. We refer to Samorodnit- 
sky and Taqqu [7] and Embrechts and Maejima [3j for systematic accounts on self-similar 
processes. 

The following theorem is concerned with asymptotic behavior of the sample function 
X(t) as t — > oo. 

Theorem 2.2. Let X = {X(t),t G K+} 6e a real-valued H-SSSI process. If there is a 
constant p > max{l, 1/H} such that E(\X (l)\ p ) < oo, then for every e > 0, 

/ N \X(t)\ 

(2.4) lim !— ^4 — = a.s. 

^°°^(logt)p +£ 

Proof. For any integer n > 1, define £ n = X(n + 1) — X(n). Then {£ n } is stationary with 

E(\£, n \P) < oo. Let (p(t) = t H (logt)p +£ and let a > 2 be an integer which satisfies the 
condition in Theorem 1.1. By the -ff-SSSI property of X, we derive that for all k > 

ms k , a n\ p ) 



This implies 
(2.5) 



E(\X(k + a n ) - X(k)\ p ) = a nHp E(\X(l)\ p ) 

Sk,a n 



supE 



n=0 



fc>0 



ip(a ri 



< oo. 



Since H > 0, we have X(0) = a.s. [7, p. 312]. It follows from this fact and Theorem ll.il 
that for every e > 

X(n) 



(2.6) 



lim 

n ^°° n"(logn)p 
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+e 







a.s. 



To show (|2.6|) still holds for continuous time t, we need an estimate on the tail probability 
of max tG [ ,i] 1-^(^)1- To this end, we note that for any integer n > 1 and < k < n, 

k 



Xli 

n 



X 



£-1 



n 



Hence, for all 1 < i < j < n, we have 



E 



(2.7) 



E 



X 



n 



X 



n 



E 



X 



n 

j-i + l 
n 



-X 

Hp 



n 



E{\X(1)\*), 



where the second equality follows from the -ff-SSSI property of X. Since p > min{l, 1/H}, 
we see that the conditions of Theorem 3.1 in Moricz, Serfhng and Stout [d* are satisfied 
with 

g(iJ)=[E(\X(l)\^ Hp)j - i + 1 
which satisfies Condition (1.2) in |6|. It follows that 



■n 



(2i 



E sup \X(t)\ p ) < i^iE(|X(l)| p ) < oo, 

,0<*<1 



where K\ > is an explicit constant depending on H and p only. Combining (|2.8I) with the 
Markov inequality gives 



(2.9) 



'( sup \X(t)\ >u) < KiE(|X(l)|P)^ p . 
\o<t<i / 



It follows from (|2.9p and the -fT-SSSI property of X that for any r] > 
(2.10) 



sup \X(t) -X{a n )\ >r]a nH {log a n y/ p+ A < K n~( 1+p£ \ 

,a n <t<a n + 1 / 

Hence by the Borel-Cantelli lemma, we have 
(2.11) 



Hm sup a n< f < g n+i \X(t) - X{a n )\ _ 



a nH {\oga n ) 1 /P +£ 
It is clear that (ggj) follows from ([231) and P^TTjl - 



a.s. 



□ 



Applying a similar argument to self-similar stable processes with stationary increments, 
the condition H > 1/p can often be weakened, as shown by the next theorem. 

Theorem 2.3. Let X = {X(t),t € K+} be a real-valued self-similar a-stable process with 
index H > and stationary increments. If the sample function X(t) is almost surely 
bounded on [0,1], then for every e > 0, 

\X(t)\ 

(2.12) lim !— ^ — = a.s. 



Proof. Let a > 2 be a fixed integer such that a Ha > max{2,2°}. The same proof as in 
that of Theorem 12.21 shows that 

2.13 lim — v '—j— = a.s. 

n^oo a nH (\oga n ) l / a+e 

Under the assumption that X has almost surely a bounded sample function on [0, 1] , we 
have 

P( sup \X{t)\ > u J < Ku~ a . 

V0<i<l / 

See [71 Theorem 10.5.1]. This and the -ff-SSSI property of X imply that 

(2.14) f( sup \X(t) - X(a n )\ > o nff (loga n ) 1 / a+e> ) < K n^ 1+a£ \ 

\a n <t<a n+1 / 

Hence (j2"7L2j) follows from ([2TT3]) . (j!TT4"j) and the Borel-Cantelli lemma. □ 

As an example, let us consider the linear fractional stable motion. Given constants 
a G (0,2) and H G (0, 1), the a-stable process {L a ^H(t),t G R} defined by 

(2.15) L ajH (t)= [ Ut - s) l' l,a - (s) A(ds) 

is called a linear fractional stable motion (LFSM) with indices a and H. In the above, 
a + = max{0,a} for all a G R and {A(t),t G M} is a two-sided strictly stable Levy process 
of index a. Note that, when H = 1/a, L at jj(t) = A(t) for all t > 0. When H ^ 1/a, the 
stochastic integral in (|2.15p is well-defined because 



H-l/a ( yH-l/a 



dr < oo. 



See [3 Chapter 3]. By ([235]) . it can be verified that {L ajH (t),t G M} is iT-SSSI Propo- 
sition 7.4.2]. It is an a-stable analogue of fractional Brownian motion and its probabilistic 
and statistical properties have been investigated by many authors. In particular, it is known 
that 

(i) If 1/a < H < 1 (this is possible only when 1 < a < 2), then the sample function 
of {L a> H(t),t G M} is almost surely continuous. 

(ii) If < H < 1/a, then the the sample function of {L at jj(t),t G M} is almost surely 
unbounded on every interval of positive length. 

We refer to [3 Chapters 10 and 12] and Takashima [8] for more information on asymptotic 
properties of LFSM. 

The following is a corollary of Theorem 12.31 

• Ifl/a<.ff<l, then for every e > 0, 

(2.16) lim |L °' g(t 1 )l = a.s. 

t^co tH(\ og t)a+ £ 

• If0<i7<l/a, then for every e > 0, 

f11-7<\ r \ L a,H{n)\ 

(2.17) lim ■ j — = a.s. 



For 1/a < H < 1, (|2,16|) is proved in Ayache, RouefT and Xiao [T] by using the wavelet 
methods. For < H < 1/a, even though {L a< H(t),t £ M} is almost surely unbounded on 
every interval of positive length, its limiting behavior along a fixed sequence is still similar 
to the 1/a < H < 1 case. 
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